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Abstract 

This work produces a q-analogue of the Cauchi-Szego integral representation that re- 
trieves a holomorphic function in the matrix ball from its values on the Shilov boundary. 
Besides that, the Shilov boundary of the quantum matrix ball is described and the U q su m ,n- 
covariance of the U q s{\x m x u n )-invariant integral on this boundary is established. The latter 
result allows one to obtain a q-analogue for the principal degenerate series of unitary repre- 
sentations related to the Shilov boundary of the matrix ball. 

1 Introduction 

Bounded symmetric domains form a favorite subject of research in geometry, function 
theory of several complex variable, and non- commutative harmonic analysis. The point 
is that they are simplest among non-compact homogeneous spaces of real semi-simple Lie 
groups. 

Quantum analogues (q-analogues) of bounded symmetric domains were introduced in 
H via replacement of the ordinary Lie groups with their quantum analogues @. A simple 
example of classical bounded symmetric domain is the unit ball U = {z e Mat n | zz* < 1} 
in the space of complex n x n matrices. The present work studies a q-analogue of this 
matrix ball. The notions of Shilov boundary and Cauchi-Szego kernel are associated to 
this subject. Just as in the case q = 1, a holomorphic function in the quantum matrix 
ball is determined unambiguously by its restriction onto the Shilov boundary and could 
be retrieved via the Cauchi-Szego integral representation. 

The proof of the latter result involves some properties of an invariant integral on the 
Shilov boundary. We also use these properties to produce the principal degenerate series of 
unitary representations of the quantum group SU n ^ n . The appendix contains a discussion 
of generalizations of the main result onto the case of rectangular matrices. 

In what follows we assume C to be the ground field, all the algebras are unital, and 
?G(0,1). 

The author is grateful to S. Sinel'shchikov for pointing out a gap in a previous version 
of the proof of proposition |6.1| and an assistance with translating this text into English. 



This research was supported in part by Award No UM1-2091 of the US Civilian Research & Development 
Foundation 
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2 A construction of the Shilov boundary 

Among the best known 'quantum' algebras one should mention the q-analogue C[Mat n ] 9 
of the algebra of holomorphic polynomials on the space of matrices Mat n . This algebra 
is given by its generators z%, a, a = 1, 2, . . . , n, and the following relations: 

2%z% -qz^zl = 0, a = b&a<(3 or a<bka = (3 (2.1) 

z a a zl - zlz a a = 0, a<(3ka>b (2.2) 

%4 - z l< = (l - r 1 )^, a<(3ka<b. (2.3) 

The work presents a definition of the *-algebra Pol(Mat n ) g , which is a q-analogue 
of the polynomial algebra on the vector space Mat n . Its generators are z%, (z„)*, 
a, a = 1,2,... , n, and the list of relations consists of fl2.1|) , ( |2.2|) , Q2.3|) , together with 
the commutation relations 



f)x = 9 2 E ^rf?4i4r (2-4) 

a',V,a,',P'=\ 



where S a b, S a/3 being the Kronecker symbols and 



' q 1 , i j ki = k & j = 1, 

1, i = j = k = l, 

-(g- 2 -l), i = j &k = l kl> j, 

otherwise. 



It is well known that the Shilov boundary of the matrix ball U is just the set S(V) of 
all unitary matrices. Our intention is to produce a q-analogue of the Shilov boundary for 
the quantum matrix ball. Introduce the notation for the quantum minors of the matrix 

z = (z«y. 

( „Ak\{au<X2,- , oik} def /_ y( s ) a s(1) a s{2) a s{k) 

\ z ^{ai,o 2 ,-,Ofc} ~~ q > ai a2 ' " ak ' 

se,S k 

with oi\ < a 2 < - - - < ctk and l(s), ai < a 2 < . . . < a^, and l(s) being the number of 
inversion in s G Sk- 
it is well known that the quantum determinant 

det ff E=(o{S::::3 

is in the center of C[Mat„] 9 . The localization of C[Mat„] 9 with respect to the multiplicative 
system (det g z) N is called the algebra of regular functions on the quantum GL n and is 
denoted by C[GL n ] q . 

Lemma 2.1 i) There exists a unique involution * in C[GL n ] q such that 



z 



with z" being the matrix derived from z via deleting the line a and the column a. 
ii) (det g z)(det g z)* = (det, z)*(det g z) = q~< n ^ . 
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Proof. The uniqueness of the involution * is obvious. To prove the existence, consider 
the *-algebra C[C/ n ] g = (C[GL n ] q ,*) of regular functions on the quantum U n (see ||) and 
the automorphism i : C[GL n ] q — > C[GL n ] q given by i : z% i— > q a ~ n z", a, a = 1, 2, . . . , n. 
Obviously, i~ l * i is an involution. What remains is to demonstrate that 

r 1 *z : ^ h-> (-g) a +«- 2 «(det (? z)" 1 det g z£. 

This follows from the definition of * || : 

(^)^ = (-g) a -«(det (? z)- 1 det (? z«. 

The statement ii) of the lemma follows from a similar statement for the involution *. 

□ 

The *-algebra Pol(S , (U)) g = (C[GL n ] q , *) is a q-analogue of the polynomial algebra on 
the Shilov boundary of the matrix ball U, as one can see from 

Theorem 2.2 There exists a unique homomorphism of *-algebras if) : Pol(Mat n ) 9 — > 
Pol(5'(U))g such that if) : z% i— > a, a = 1, 2, . . . , n. 

We premise the proof of the theorem with two remarks. Firstly, the homomorphism 
if) is a q-analogue of the operator which restricts the polynomial onto the Shilov bound- 
ary. Secondly, we use in this work a purely algebraic approach to producing the Shilov 
boundary; we do not try to compare it to the analytic approach of the well known work 
by W. Arveson HJ. 

Proof. The uniqueness of the ^-homomorphism if) is obvious. Turn to the proof of its 
existence. To produce if), we need auxiliary *-algebras Pol(Pl nj 2 n )g,x and J x , together with 
the embeddings of algebras Pol(Mat n ) g <^-> Pol(Pl nj 2n) 9 ,a:, Pol(S'(U)) 9 9v The crucial 
point in the proof is a construction of a homomorphism of *-algebras Pol(Pl ni 2 n )g,a; — ► 9x 
which leads to the commutative diagram 

Pol(Pln,2n)g,x ► ^x 



Pol(Mat n ) 9 > Pol(5(U)),. 

To begin with, introduce the *-algebra Pol(Pl nj 2n)g,a; 'of polynomials on the quantum 
Pliicker manifold'. 

Let C[Mat2n] g be the *-algebra of functions on the quantum space of matrices Mat 2n 
determined by its generators {tij}i,j=i,2,...,2n an d commutation relations similar to those 
listed in Q2.1| ) - (|2.3|). Introduce the quantum minors 

ff\n _ ST^ I _ \l(s) f f + 

s£S„ 

determined by pairs of n-element subsets of the form 

I = ■ ■ ■ ,i n )\ 1 < k < ■ ■ ■ < in < 2n}, 

J = {(jl,j2, ■ ■ ■ ,jn)\ 1 < jl < ■ ■ ■ < jn < 2^}. 
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Consider the subalgebra in C[Mat2 n ]<j generated by the elements tj™ 2 n y, 
^{n+in+2 2n}j' with card(J) = n. It is easy to present a full list of relations between 
these generators. We follow M in equipping this algebra with the involution 

(t% 2 ,... MJ y = (-i) card({i ' 2 - n}nj) (-g)' (j ' jc) ^ +1 ,. +2 ,..., MJC , (2.5) 

where J c = {1,2,... , 2n} \ J and l(J, J c ) = card{(f, j") e JxJ c \f > j"}. The *-algebra 
arising this way is denoted by Pol(Pl„ j2 n) g - Let t = t^ 2 ra }{ n+ln+2 2n } an< ^ x = 
Obviously, x quasi-commutes with all the generators of Pol(Pl ni 2 n )g- 

Let Pol(Pl n> 2n) 9 ,a: be the localization of the *-algebra Pol(Pl ni 2 n ) g with respect to the 
multiplicative system x N . The results of section 2 of || can be used to prove the following 
statement intended to shed some light to the way the *-algebra Pol(Pl ni 2 n )g works in our 
constructions. 



Lemma 2.3 Let J aa = {a} U {n + 1, n + 2, . . . ,2n} \ {2n + 1 - a}. The map 1 : z% h-> 

t~H^ 2 n | Ja admits an extension up to an embedding of the *-algebrasX : Pol(Mat n ) g — > 

Pol(Pl n ,2n)ij,2: 



The next step in proving theorem |2]2| is in producing an auxiliary *-algebra 3 r , together 
with a homomorphism of *-algebras ip : Pol(Pl n) 2n) g — * 3 r - Let C[Pl n) 2 n ]g C Pol(Pl n)2n ) 9 be 
the subalgebra generated by the quantum minors t|™ 2 n yj, card( J) = n, and C[Pl ni2n ] 9 C 
Pol(Pl rai2n ) g the subalgebra generated by the quantum minors t^ +ln+2 2n yj, card(J) = 
n. 

3 appears to be an extension of C[Pl n) 2 n ]<?; it is given by adding the elements rj, 7/ _1 
to the list of generators and the relations 

m~ X = V^V = 1, Vt{i,2,... ,n}j = Q~ n t{i,2,... ,n}jV, card(J) = n 

to the list of relations. (As it is well known, this list is exhausted by the commutation 
relations and q-analogues of Pliicker relations). 

Lemma 2.4 The map 

^ft,,«}i wt {U..,4i ( 2 - 6 ) 

V 9 : t{n+l,n+2,...,2n}.J l— ^ V^{1,2,... ,n}J (2-7) 

admits an extension up to a homomorphism of algebras tp : Pol(Pl nj 2 n )g ~~ ► $ ■ 

Proof. The definitions imply the existence of a homomorphism C[Pl nj 2n]<j — * 3 which 
satisfies (|2.6| ) and a homomorphism C[Pl nj2 n]g — > & which satisfies (|2.7| ). The rest of 
the relations between the generators of Pol(Pl nj 2n)<j are commutation relations. What 
remains is to establish that the same commutation relations are also valid for images 
of the elements £{™ 2 n yj, t^ +1 n+2 2n i J with respect to <p. For that, we use the R- 
matrix form of commutation relations between the matrix elements of the corresponding 
fundamental representation of the Hopf algebra U q s\% n . 

Const (5 , ) n )^{n+l,n+2,...,2n}7^{L2,...,n}J = ^IJ t{ 1,2,... ,n} J'^{n+l,n+2,... ,2n}I' > 

{/',J'|card(/')=card(J')=n} 
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C0nst"((7, n)t{™ 2 , ... ,n}I^ {1,2, ...,n}J ~ ^2 ^JJ ^l,2,...,n}J'^{l,2,...,n}I'- 

{I',J'\ card(/')=card(J')=n} 

Here (Rjj ) is the R-matrix from the right hand side of the well known relation RTT = 
TTR g], and the constants const' (q, n), const" (q, n) describe the action of the R-matrix in 
the left hand side of that relation. We are to prove now that const"(g, n) = q~ n const' (q, n). 
This follows from 

j.Anj.Ara jAbjAh jAriiAn rij.Anj.An 

l ji l u — l ii l ij — y L u L iii 

with I = {1,2,... ,n}, J = {n + 1, n + 2, . . . , 2n}. □ 
Equip 3" with an involution. 

Lemma 2.5 i) There exists a unique involution * in "J such that 

rf = q-^-^r]- 1 , 

W ra 2 ^ }jr ^ 

ii) The above homomorphism ip : Pol(Pl n)2n )q — ► 3 is a homomorphism of *- algebras. 
Remark. The motives to deduce the latter equality are as follows: 

(*&,... ,n},)* = (<P (t^,..rij)Y = V W?,2,.,n}jY) = 

= (-lJ^A-^C-g)^)^ (t% +1 , n+2 ,..., 2n}JO ) = 

= (-l) card({1 ' 2 '---' n}nJ H-g)' (J ' J ^-tff 2 ,..., n}Jc . 

Proof. The uniqueness of the involution * is straightforward, and its existence follows 
from Q2.5|). More precisely, ( |2.5| ) and the isomorphism C[Pl n)2n ]— ^C[Pl n)2n ], t^ 2 ,j 1— > 
^{n+in+2 2n.}j5 car d(</) = n, imply the existence of an antilinear antiautomorphism * : 
J — > 3" with the required properties. The property ** = id is to be verified separately: 

(.An \** _ l(J,J c )+l(Jc, J) .An * _ „n 2 -n,/\n * _ -An 

\ l {l,2,...,n}j) —1 U l {l,2,... ,n} JV ~ Q t {l,2,...,n}JW ^{1,2,... ,n}J- 

Now the definition of the involution and ( |2.5| ) imply that (p is a ^-homomorphism. □ 

Note that ip admits a unique extension up to a homomorphism <p x : Pol(Pl ni2n ) g ,a; — ¥ 9x 
of the localizations of Pol(Pl„ j2n ) g and 3 with respect to the multiplicative system x n , 
x = tt*. 

Here is the last element of our construction. 

Lemma 2.6 The map z% i— > t~H^ 2 n y Jaa , a,a = 1,2, . . . ,n, admits a unique extension 
up to an embedding of *- algebras Pol(5 , (U)) 9 — > 3^. 

Proof. Note first that l(J aa , Jaa) = a + a + (n — I) 2 — 2. Hence 

(f-UAn \* _ 

\ l l {l,2,...,n}J aa ) — 

= A-<lT +aHn - l)2 -Mh,...M^ ((-?) n2 ^{i:2,..,n }{ l,2,...,n } ) _1 = 

- I „\a+o— 2n— 1 + An /-/-An \ ~ 1 _ 

- -y-Q) l {l,2,...,n}Jg a \ Z {l,2,...,n}{l,2,...,n}) ~ 

/ ^\a+a-2n fj.An \ _1 + An 

- \-Q) ^{l,2,...,n}{l,2,...,n}J Z {1,2,... ,n}Jg a ~ 

— ( „\a+a—2n (±— l±An \ _1 ( + -1 + An \ 

~ [-Q) \? l {l,2,...,n}{l,2,...,n}) { Z Z {1,2,.. .,n}Jg J ■ 
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On the other hand, in the algebra <C[Pl ni 2n]<j,t defined as a localization of C[Pl ni 2 n ]g 
with respect to the multiplicative system t N , one has the following relations, established 
in 1: 

* t{l,2,...,n}{l,2,...,n} = det g Z, 

+~ l +^ n - Apt 7° 

1 Z {l,2,...,n}JZ a — ael q z a- 

What remains is to use the natural embedding C[Pl nj 2 n ]g,t — ► 3a;- D 



To complete the proof of theorem |2.2| , one has to observe that the *-homomorphism 
Pol(Pl n>2n ) gj2: — > 3 X takes the images of z" G Pol(Mat n ) g with respect to the embedding 
Pol(Mat n ) g <^-> Pol(Pl ni 2n) g to the images of the corresponding elements G Pol(S f (U)) g 



with respect to the embedding Pol(S f (U)) g J x . Now theorem |272| is proved. □ 



Proposition 2.7 i) Imip = Pol(S(U)) g . 

ii) ker-^ C Pol(Mat n )q constitutes a U q sl2 n -submodule. 

Proof. The first statement follows from (det^z)" 1 = q n ^ n ~ 1 \det q z)* , since z" G 
Imip for all a, a = 1,2, .. . ,n and (det g z)* G Irrr0. The second statement involves the 
structures of CT^s fen-module algebras in Pol(Mat n ) giX , J x , which are imposed in an obvious 
way (the elements r\,r\~ x G & x are ?7 g sfe n -invariants). The statement to be proved follows 
now from the fact that the homomorphisms Pol(Mat n ) 9 — > Pol(Pl n)2n ) g ,x) Pol(Pl n ,2n)g,x — > 
3 X are morphisms of U q sl 2n - modules. □ 

Recall the notation Ei, Fj, Kf x for the standard generators of the Hopf algebra t/ g sfe n 
and the notation U q s\x n ^ n for the Hopf *-algebra ( y U q sl 2n , *), with 

E* = -K n F ni F: = -E n K~\ (K± l y = K±\ 

ET = K j F j , F* = E 3 Kj\ {Kf l Y = Kf\ for j ? n. 

Equip Pol(5 , (U))g with a structure of L^su^-module algebra via the canonical iso- 
morphism Po\(S(V)) q ~ Pol(Mat n ) 9 / ker if). Thus, S(V) q is a homogeneous space of the 
quantum group SU ntn . 

To conclude, introduce one more £/qSu njn -module algebra. 

It was noted earlier that z%, a, a = 1,2,... , n, generate the *-algebra Pol(S , (U)) g . 
Consider its extension in the class of *-algebras given by adding generator t, together 
with the additional relations 

tt* = t*t, tz a a =q- l z% fz a a =q- 1 z a a e i a, a = 1, 2, . . . , n. 

This algebra will be denoted by Pol(S(U)) q . Our intention is to extend the structure of 
t/ 9 su nin -module algebra from Pol(5(U)) g onto Pol(S , (U)) g . This is accessible via embed- 
ding the *-algebra Pol(S , (U)) g into the *-algebra J x . i : t i— > t, i : z% i— > t~H^ 2 n yj aa , 

a, a — 1, 2, . . . , n. In fact, the *-subalgebra z(Pol(S , (U)) q ) contains all the elements t, 
t _1 t|™ 2 n xj, card(J) = n, and hence is a L^su^-module subalgebra. What remains is 

to transfer this structure onto Pol(5(U)) 9 . It follows, as, in |7|, that 

Ejt = Fjt = {Kf l - l)t = 0, n, 

F n t = (Kf - l)t = 0, E n t = q- 1/2 tz n n . 

The £/qSu nin -module algebra Pol(S , (U)) g will be an essential tool in producing the 
principal degenerate series of representations of the quantum group SU n , n . 



6 



3 A UqS^n-invariant integral 



There exists a unique invariant integral on the quantum group U n normalized in such a 
way that J ldv = 1. Use the natural isomorphism of *-algebras Pol(5(U)) 9 — > C[U n ) q , 

{Un) q 

z a l— *■ Q a ~~ nz ai a, Qf = 1, 2, . . . ,n, to transfer this integral onto Pol(S'(U)) 9 . It is easy to 
demonstrate that the linear functional we get this way 



Pol(S(U)), -> C, 




S(U), 



is not f/ g 5[ 2n -invariant provided Pol(S , (U)) g is equipped with the ordinary structure of 
f^j-S^n -module. This section is intended to prove the ?7 g s[2 n -invariance of this integral 
with respect to a 'twisted' structure of C/ g sl 2 n- m odule in Pol(S(U)) q . It is custom to say 
'these are not functions that should be integrated, but highest order differential forms'. 
The change of the structure of U q £\<irc module in Pol(S'(U)) 9 is nothing more than a passage 
from functions to highest order forms. 

Recall the notation F,, K i 1 for the standard generators of the Hopf algebra U q sl2 n , 
and U q s(gl n x gl n ) stands for its subalgebra, generated by K^ 1 , Ej, Fj, Kj 1 , j n. It is 

easy to prove the U q s(gl n x g[ n )-invariance of the above integral / i— > J fdv. 
We use the notation U q s(u n x u n ) = (U q s(gl n x gl n ), *) 



Proposition 3.1 There exists such a structure of U q sl2 n -module in Pol(S , (U)) g that 

i) its restriction to the subalgebra U q s(gl n x gl n ) coincides with the restriction of the 
standard structure of U q s(gl n x g[ n )-module in Pol(S , (U)) g , 

ii) the integral Pol(5 , (U)) g — >• C, / i— > J fdv, is a morphism of ' UqSlzn-modules. 

S(V) q 

Proof. We first produce some structure of U q sl2 n - module in Pol(S , (U)) q , and then 
prove that it satisfies i) and ii). 

Consider the t/qSUn^-module *-algebra Pol(S(V)) q introduced in the previous section. 
The construction implies that the *-algebra Pol(S , (U)) g is generated by t, t*, and the 
elements of its ?7 g su njn -module subalgebra Pol(5 , (U)) g . Consult H] for explicit formulae 
which describe the action of the standard generators Ej, Fj, Kp , j — 1, 2, . . . , 2n — 1; 
the action on the conjugate elements is easily derivable from those formulae since 

(£/)* = (S(OTf\ t e u q sun, n , f g Po\(S(u)) q . 

The elements t, t*, x quasi-commute with all the generators t, z%, a, a = 1, 2, . . . , n, of 
the *-algebra Pol(S(U)) q . This allows one to consider the localization Po\(S{U)) q ^ x of this 
*-algebra with respect to the multiplicative system x N and then to extend the structure 
of [/ g su njn -module algebra onto it. Equip Pol(S'(U))q iX with a bigrading: 

degt = (1, 0), deg t* = (0, 1), deg(z a a ) = deg«)* = (0, 0), a, a = 1, 2, . . . , n. 
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Obviously, the homogeneous components 

Pol(£(U))g) ={fe Po\(S(U)) qtX \ deg / = (i, j)} = r • Pol(£(U)) 9 • f 

form submodules of the [/^s^n-module Po\(S(V)) qjX . Equip Pol(S , (U))q with a structure 
of [/gSU^-module via the vector space isomorphism 

Pol(5(U)) 9 - Pol(5(U))(- n -- n \ / ~ (tT n ft- n . 

It follows from the U q s(gl n x g[ n ) -invar iance of t, t* that the new C/gSfen-module structure 
in Pol(S'(U))g coincides with the previous one on the subalgebra U q s(gl n x gl n ) c t/ g st 2n . 
So, our integral is again L/gS(g[ n x g[ n )-invariant. What remains is to prove that 

J(tTF n ((tT n ft~ n )t n du = 0, 

S(V) q 

J (t*) n E n ((tT n ft' n )t n du = o, fe Pol(£(U)V 

S(U)„ 

Observe that the integral in question is a real linear functional J f*dv = J fdv, and 

S(U), S(U), 

Pol(S'(U))g ia ; is a t/ g su ni „-module *-algebra. Thus, it suffices to prove the following 

Lemma 3.2 For all f e Pol(5(U)), ~ Pol(£(U))£, 0) one has 

{t*) n F n {{t*)~ n fr n )t n dv = 0. (3.1) 



S(U) 



Proof. Identify the subalgebra Pol(S'(U)) 9 with its image under the embedding into 
J x to note that F n t = F n r\ = 0, t* = (—q) n rjt det g z. Hence is equivalent to 

J (det, z)™F n ((det 9 z)""/)^ = 0. (3.2) 

S(V) q 

On the other hand, K n det q z = q 2 det q z, as one can see from an explicit form for K n z", 
a, a = 1,2, .. . , n. Hence, by a virtue of the U q s(u n x u n )-invariance of the integral in 
question (|3.2j ) is also equivalent to 

J (det, z)"F n ((det 9 z)~ n f)du = 0, (3.3) 

S(V) q 



with F n = K n F n . 



We start with proving (|3.2|) , ( |3 .3|) in the special case / = z%. In view of the relation 

F n z™ = q 1 ! 2 one has 

(det 9 z)"F n ((det g z)-X) = (det, z)"F n ((det, z^K^z^) + q 1 ' 2 . 
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Apply the explicit form for F n z%, K^z®, a, a = 1, 2, . . . , n, found in |7j to establish that 

o 2n — 1 

(det,z) n F n ((det 5 z)- n ) = g 1 / 2 ^— (det 9 z)" 1 det.K). 



Hence 

-,2« 



(det, z)"F n ((det g z)~X) = q ^L-—t(det q z)" 1 det,(z")g- 2 < + q 1 ' 2 . 



On the other hand, (det g z) 1 det g (z^) = (z™)*. Thus to prove ( |3.2D in the special case 
/ = 2™, we need only to verify that 

1 — q 2 

z n „Yz n „dv 



-n) ~n-- i _ n 2n 



1-q 2 

5(D), 

For that, it suffices to elaborate the following relations: 



WW* = J{z n n yz n n du, 

5(U„) a (U„) q 



q -(n-i) i _ q i 



qn-1 _|_ gn-3 _|_ _ _ _ _|_ q-(n-3) _|_ g-(n-l) ]_ _ g2n ' 



The first relation follows from the explicit form for the natural isomorphism of *-algebras 
Pol(5'(U)) f; ~ C[U n ] g , and the second one is a consequence of the orthogonality relations 
for the quantum group SU n (see p], p. 457]). 

In the special case / = z™, ( |3.2|) , and hence (|3.3| ) are proved. 

Turn to the general case / G Pol(S'(U)) 9 . 

Normally we work with admissible (see ]7| ||) modules over quantum enveloping alge- 
bras. We also use the standard basis Hi, . . . , H 2n -i of the Cartan subalgebra of s^n- 

n— 1 n— 1 

Let i/o = XI J-^j + n H n + X] jH2n-j be the element of the Cartan subalgebra of 

i=i i=i 

the Lie algebra s(g[ n X g[ n ) C s^n, which is in its center and is normalized so that 
[Ho, E n ] = 2E n , [Ho, F n ] = —2F n . Associate to every admissible simple finite dimensional 
U q s(gl n xgl n ) -module V a pair (A, k), with A being the highest weight of the corresponding 
UgSln (g> f/ g sl n -module, and the number k is determined by H v = 2kv, v G V. It is easy 
to obtain the following decomposition of the U q s (gl n x g[ n )-module Pol(S , (U)) g into a sum 
of simple finite dimensional pairwise non- isomorphic U q s(gl n x g[ n )-modules: 

Pol(5(U)) g = 0\/ {A , fc) . 
(\,k) 



Assume that for some / G Pol(5'(U)) g (3J3) fails. Our immediate intention is to prove 
that / belongs to some component V(A',fc')> and to find the corresponding pair (A', k'). 

The presence of the structure of U q s(gl n x gl n ) -module in Po\(S(V)) q leads to a struc- 
ture of U q #(gl n x g[ n )-module in EndcPol(S'(U))q and a morphism of U q #(gl n x g[ n )-module 
algebras U q s\.2n — > EndcPol(S'(U)) g . Consider the linear operator in Pol(S , (U)) 9 : 

L : t/j i-> (det 9 z) n F n ((det g z)-». 
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Prove that the U q s(gl n x gLj-submodule of the U q s(gl n x g[ n )-module EndcPol(S'(U)) (? 
generated by L is isomorphic to Vr\» ik /n, with A" = (0, . . . , 0, 1, *, 1, 0, . . . ,0), k" = — 1. 

In fact, F n generates a finite dimensional simple U q s(gl n x g[ n )-submodule of the U q s(gl n x 
g[ n )-module U q &\m in view of the Serre relations for F\, F 2 , . . . , F 2n _i and the relation 

adq(Ej)F n = 0, j ^ n. 

What remains is to apply the commutation relations between Kj 1 , j = 11, 2, . . . , 2n— 1, 
and F n . 

Now we are in a position to finish the proof that / G Vrx',k') an d to find A', k'. 
Use the natural embedding EndcPol(S(U)) 9 ® Pol(S(U)), -> Pol(S(U)) g and the fact 
that L G V(A",fc"), Lf G CI, to get a non-zero morphism of C/ g s(0[ n x gLj-modules 

V[x" k") ® © ^(A,fc) J ~~ * C. This means that fc' = —A;" and A' is the highest weight of 

the dual representation of U q sl n <g> f/ g sl n . Finally, A' = (1,0,... , 0, *, 0, . . . , 0, 1), k' — 1. 
Furthermore, / is the lowest weight vector in Vr\',k') since L is the highest weight vector 
in Vix",k")- ^ follows that / = const ■ z™, which contradicts to the relation ( |3.3| ) proved 
earlier for □ 



4 On certain irreducible *-representation of U q su n ^ 



Consider the embedding X : C[Mat n ] g C[Pl nj 2 n ]g,t described in Lemma [D| and another 
embedding 

J ■■ C[Mat n ] 9 -> C[Pl n , 2 „U t7 : / >-> (X/)t~ n . 

It is easy to verify that j7"C[Mat n ] g is a submodule of the t/gSfcn- module C[Pl nj 2n] g ,t. Hence, 
there exists a unique representation 7r of U q sl2 n in the vector space C[Mat n ] g such that 



2/1- 



We refer to the previous sections for constructions of a *-homomorphism 

V : Pol(Mat n ) 9 - Pol(5(U))„ V : / - /|s(U)„ 
and an invariant integral 



Pol(S(U)), - C, /hh. J 



fdu. 



S(V) q 

These are to be used to equip the vector space C[Mat n ] g with a Hermitian scalar product 

(A,/2)= f / (/2|s(U)„)*/l|s(U)„^- 



5(U) 



The following lemma is a consequence of the definitions of £/qSl 2n - module structures and 
invariance of the integral. 
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Lemma 4.1 For all £ G U q su n , n , fi, f2 G C[Mat n ] g one has 

(ir(0/i,/ 3 ) = (A,ir(O/a)- 

To rephrase, 7r is a ^-representation of f/gSu n>n in the pre-Hilbert space C[Mat n ] g . The 
proof of irreducibility for this representation uses the following 

Lemma 4.2 If for some f G C[Mat n ] g and some mi, 777.2, • • • , rri2n-i £ Z one 

= Kf 1 f = q ±m if, j = l,2,...,2n-l, (4.1) 

t/ien / G CI. 

Proof. Due to F t f = 0, i ^ n, Kf l f = q ±m ^f, j = 1, 2, . . . , 2n - 1, it follows that, 
up to a constant complex multiple 

/ = (<)*" (det a z~)'"-' (det,z-~"')^ ' ' ' (<•*■)*■ 

for some k%, k 2 , . . . ,k n G Z + . Prove that F n / = implies k± — k 2 — . . . — k n — 0. Let 
J be the two-sided ideal of C[Mat n ] g , determined by the 'non-diagonal' generators z%, 
a 7^ a. Obviously, K~ X J C J, F n J C J. This allows one to arrange computations modulo 
the ideal J: 

71 — 1 a n 

F n f = const n^)^ 1 *' W^ 1 **" 1 ( mod J ) 
0=1 

1/2 " -2 £ g- 2fc ,-l 

const = q l/z > <= J +1 ■ - — . 

^ q- 2 - 1 

Now the isomorphism C[Mat n ] 9 / J ~ C[^J, z%,. . . , 2"] implies the relation const = 0, that 
is, &i = k 2 — . . . = k n = 0, which is just our statement. □ 

Proposition 4.3 The representation tt is irreducible. 

Proof. Suppose tt is reducible. Then by lemma |4.1| it is a sum of two non-trivial 
admissible subrepresentations in the subspaces L±, L 2 : C[Mat n ] g = L\ © L 2 . Each of 
those further decomposes as a sum of weight subspaces and, in particular, possesses a 
lowest weight vector. This vector / 7^ satisfies the relations 

7r(F i )/ = 0, 7r(K± 1 )f = q ±m >f, J = l,2,... ,2n-l. 

On the other hand, in C[Pl nj2ri ] g ,t one has: 

u(Kf 1 )t= \f H ' J = H , n(F 3 )t = 0, j = l,2,...,2n-l. 

We conclude that / is a solution of the equation system ( |4.1|) , so, by a virtue of lemma 



4T2| , / G CI. Hence, L% D CI, L 2 D CI, L\ H L2 7^ 0. This is a contradiction coming from 



our assumption on reducibility of tt. The proposition is proved. □ 
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5 The Cauchi-Szego integral representation 



Recall that C[Mat n ] g C Pol(Mat n ) 5 stands for the subalgebra generated by (z%)*, a, a 
1,2,... , n. We follow M in introducing the algebra 



C[Mat„ x Mat n ] 9 = C[Mat n ]° p ® C[Mat„ 



with op indicating the change of a multiplication law to the opposite one. This algebra 
is bigraded: 

deg(z2 ® 1) = (1, 0), deg(l ® (z^)*) = (0, 1). 



Its completion with respect to this bigrading is denoted by C[[Mat n x Mat n ]] g . The 
elements of C[[Mat n x Mat n ]] g are q-analogues for kernels of integral operators, while the 
elements of the subalgebra C[Mat n x Mat n ] g are q-analogues of polynomial kernels. 
We refer to || for a definition of the pairwise commuting 'kernels' 



Xk 



z Ak j» ® (z Ak j„y G C[Mat„ x Mat n 



./', J"C{1,2,... ,«} 
card(j')=card(j") = fc 



and a one-parameter family of the elements of C[[Mat n x Mat n ]] g which includes the kernel 

re— 1 / n ^ 

C * = U i+Ehw** 

j=0 \ fc=l , 
We write C,(z,C*) instead of C q , C,(z,C*)'/(C) instead of and ^ /(C)<M0 

instead of ^ /Isfu),*^ as it is custom in the classical analysis. It is easy to demonstrate 

S(D), 

H proposition 2.11] that in the formal passage to a limit q — > 1 one has C g (z,£*) — ► 
det(l-zC*)- n . 

We call C g G C[[Mat n x Mat n ]] 9 the Cauchi-Szego kernel for the quantum matrix ball. 

The following result provides a motivation for this definition. 

Theorem 5.1 For any element f G C[Mat n ] g one has 

f(z)= J c 9 (z, 0/(0^(0- 

S(D) 9 

Proof. Equip Pol(Mat n ) g with a grading: deg(z") = 1, deg(z")* = —1, a, a = 
1,2, ... ,n. It is easy to show that J f\s(U) t dv = for all / with deg(/) ^ 0. Hence 

5(0), 

the integral operator 

T : C[Mat n ] 9 - C[Mat n ]„ T : f(z) h-> ^ C,(z, O/(C)<M0 
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is well defined. It follows from the invariance of the integral on the Shilov boundary and 
the results of || section 8] that 7r(£)T = Tn(£) for all £ G U g sl2 n . Furthermore, Tl = 1. 
Hence Tf = f for all / e C[Mat n ] g in view of proposition |4.3[ The theorem is proved. □ 

Note that there exists another proof of theorem |5.1| which uses only the orthogonality 
relations for the quantum group U n and one of the Milne's relations for Schur's functions 
0. We intend to publish this proof in a future work. 



6 Appendix. Another description of the *-algebra Pol(£(U)) g 
and its generalization onto the case of rectangular matrices 

We produce a system of equations which distinguish the quantum Shilov boundary from 
the quantum matrix space. This is certainly equivalent to describing the *-algebra 
Pol(5 , (U))g in terms of generators and relations. 

Proposition 6.1 In Pol(5'(U)) g the following relations are valid: 

n 

^ q %n-u-p z a^y _ 5 ap = ^ a , (3 = 1,2, . . . ,n. (6.1) 

3=1 

The left hand sides of these equations generate the kernel of the canonical homomorphism 
z/> : Pol(Mat„), -> Pol(£(U)) ? . 

Proof. The first statement is due to the fact that in C[C/ n ] g 

n 

J2z-(^Y-^ = 0, a,(3 = l,2,...,n, 

3=1 

Let I be the two-sided ideal of Pol(Mat n ) g generated by the left hand sides of ( |6.1| ) and 
A = Pol(Mat n ) g /X. One has to prove that the canonical onto map j : A — >• Pol(5 , (U)) g is 
in fact an isomorphism. 
First prove that in A 

det q z ■ (det q z)* = . (6.2) 

Equip A with a Z-grading as follows: 

deg«) = 1, deg(«)*) = -1, a,a = 1,2,... ,n 

It was demonstrated in section 2 that the relation (|6.2| ) is valid in Pol(S , (U)) g . What 
remains is to use the fact that the algebra A is a f/ g sl n -module algebra, together with the 
following statement: 

Lemma 6.2 

i) det g z • (det g z)* e A is a U q sl n -invariant of degree zero. 

ii) The subalgebra of U q sl n -invariants of degree zero in A is one-dimensional. 
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P ro of of lemma 16 . 2 . The first statement is obvious. Turn to the second statement. For 



any U q si n - invariant of degree zero / G A there exists such f/ g s[ n -invariant of degree zero 
/ G Pol(Mat n ) g that f = j- /.Q On the other hand, Pol(Mat n ) g is a free C[Mat n x Mat n ]- 
module generated by 1 G Pol(Mat n ) g : 

fx ® /2 : 9i ® 92 </i/i ® /a</2- 



Consider / G C[Mat n x Mat n ] such that / = / o 1. It suffices to prove that / is in the 

n 

subalgebra generated by Yl q 2n ~ a ~^ ® { z j)*i ot, f3 = 1,2, ... ,n. This is a consequence 

i=i 

of the fact that / is a [/ g s[ n -invariant of degree zero, and a q- analogue of the first main 
theorem of the theory of invariants ||. □ 

It follows from (|6.2| ) that det g z G A is invertible. Hence one has a well defined ho- 
momorphism of algebras f : Pol(5(U)) 9 — > A, f : z% t— > z%, a, a = 1, 2, . . . ,n. Obviously, 
jf = id. What remains is to prove that f is onto, that is the elements (det g 2) _1 , z%, 
a, a = 1, 2, . . . ,n, generate the algebra A. It follows from (|6.1|) and well known properties 
of quantum determinants that in A one has 



XT = (-q) a+a - 2n (det q z)- 1 det q z a a , a, a = 1, 2 



So, j is invertible. The proof of proposition is complete. □ 

Thus we get another description of the *-algebra Pol(5 , (U)) g . It is to be used for 
producing a q-analogue for the Shilov boundary of a unit ball in the space of rectangular 
matrices Mat mjfl , m < n. 

The classical theory of Cartan domains M provides a well known procedure of produc- 
ing the Shilov boundary S(U') of the unit ball U' C Mat TO) „, together with the associated 
Cauchi-Szego kernel for the unit ball U C Mat ra . We are going to apply exactly this 
method in the quantum case. 

Consider the *-subalgebra Pol(Mat mjn ) g C Pol(Mat n ) g generated by z%, a > n — m, 
and the *-Hopf algebra C/ ? 0lV, n C U q su n , n generated by Ej, Fj, Kj, j < m + n. It is 
easy to demonstrate that Pol(Mat mjn ) g is a U q su m , n -modu\e subalgebra of the U q 5u m ^ n - 
module algebra Pol(Mat n ) g . Up to relabeling the generators, this [/ g su mjn -module algebra 
coincides with the *-algebra of polynomials in the quantum matrix space considered in 

Introduce the notation Pol(S'(U')) 9 for the *-algebra determined by its generators 
z%, a = 1, 2, . . . ,n; a = n — m + 1, n — m + 2, . . . ,n, 
the commutation relations loan from Pol(Mat m)n ) g and the additional relations 

n 

q 2n ~ a ~ p z^z^)* = 5 a >P, a, (3 = n - m + 1, n - m + 2, . . . , n. 

i=i 

Our construction implies a commutative diagram 

Pol(Mat m>n ) g ► Pol(Mat n ) 9 



Pol(S-(U')) g > Pol(5(U)) ? 



1 Due to local finiteness of the J7 g s[ TO -modules I, Pol(Mat n ) 9 , A. 
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where the vertical arrows stand for the homomorphisms of restriction of 'polynomials' 
onto the Shilov boundaries of the corresponding quantum balls. The homomorphism 
Pol(S'(U / ))g — > Pol(5 , (U))q allows one to transfer an invariant integral from Pol(S'(U)) g 
onto Pol(S'(U / )) (? . The Cauchi-Szego kernel is defined as in section 5 except that in the 
expression for Xk, the summing up in J' C {1,2, .. . , n) is replaced with summing up 
in J' C {n — m + 1, n — m + 2, . . . ,n}. Another result of section 5, a q-analogue of 
the integral Cauch-Szego representation for the matrix ball U', implies a similar integral 
representation for the quantum matrix ball in the space of rectangular matrices. 
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